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Icomputer  Graphics  has  been  a  vector  oriented  high  technology  for 
interaction  and  its  images  have  been  those  of  a  silent  movie. 
Current  trends  toward  raster  scan  in  general  are  bringing  together 
the  previously  disjoint  communities  of  image  processing,  broadcast 
television  and  computer  graphics.  Present  implementations  in 
video  format  are  making  computer  graphics  ubiquitous.  Jointly, 
these  events  are  leading  to  broader  definitions  of  man-machine 
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interaction  and  more  generalized  applications  of  computer  resource 
The  user  community  is  growing  to  include  people 'like:  presidents 
of  companies,  housewives,  six  year  old  children. 

In  this  light,  this  paper  is  about  not  throwing  away  the  message 
with  the  medium  while  offering  new  technological  opportunities 
for  communication.  In  many  regards  the  old  fashioned  book  remains 
the  best  random  access  information  resource  we  have,  but  new 
opportunities  include:  personalization,  sound  synchronization, 
spatial  data  access.^ 
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View  of  the  Media  Room  as  used  in  the  Spatial  Data-Management  System. 
The  world  view  of  Dataland  is  to  the  user's  right.  Note  the  arms  of 
the  chair  are  each  equipped  with  joystick  and  touch  sensitive  pad  (the 
right  one  of  which  is  being  used  to  flip  the  pages  of  the  calendar) . 
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Top  left:  close-up  of  joystick  control.  Middle  and  bottom  left: 
a  touch  sensitive  index  of  SDMS  Workbook.  Right  top,  middle  and 
bottom:  using  a  touch  sensitive  world  view  to  move  from  book  to 
museum  map,  to  the  Southeast. 


THE  PAGE  AS  A  SYNTACTIC  CHUNK 


PAGES  WITHOUT  PAPER 


Scrolling  text  on  a  computer  terminal  is 
so  commonplace  that  it  may  be  alarming  to 
question  it.  But  really  it  is  rather 
dreadful.  Most  of  the  time  it  cannot  be 
read  when  moving.  Almost  all  of  the  time 
it  gives  the  user  absolutely  no  sense  of 
where  he  or  she  is  vis-a-vis  some  whole. 

We  take  for  granted  the  semantic  constructs 
of  grammar.  A  sentence  carries  a  statement 
or  question  and  a  paragraph  can  be  said  to 
develop  or  support  an  idea.  One  way  or 
another,  chapters,  subsections,  paragraphs 
and  sentences  can  be  seen  as  descending, 
semantic  boundaries. 


The  optical  videodisc  illustrated  below  is 
a  particularly  new  and  important  medium 
for  information  dissemination.  The  page 
counterpart  is  a  frame,  of  which  54,000 
are  available  today,  on  a  randomly  access¬ 
ible  basis,  at  very  low  cost.  In  the 
computer  community  54,000  or  54K  is  an 
insignificant  number  when  measuring,  for 
example,  bits,  bytes,  or  words  of  memory. 
But  54,000  slides  or  54,000  pages  is  quite 
a  different  matter.  A  PhD  student  of  Art 
History  does  not  encounter  54,000  art 
slides  in  his  or  her  education,  probably 
career.  54,000  pages  is  more  than  the 
Encyclopedia  Britanica  with  all  its 
annual  updates. 


But  there  are  also  syntactic  boundaries 
tied  to  the  medium  of  presentation  more 
than  to  the  information  content.  The  page 
is  an  excellent  example.  The  ideas  in  a 
letter  or  a  book  clearly  do  not  fall  on 
page  boundaries .  But  one  remembers  a  three 
page  love  letter  or  nine  hundred  page 
novel  partly  as  such.  A  recent  directive 
from  the  National  Science  Foundation  has 
limited  proposals  to  fifteen  pages. 


The  pictures  on  the  following  page  are 
taken  from  a  student  thesis  (2) .  As 
illustrated,  the  text  is  almost  print 
quality,  does  not  scintillate,  and  has  all 
the  letter  size  and  spacing  variables 
common  to  printing.  In  addition,  with  the 
small  overhead  of  animation,  pages  are 
flipped  from  the  upper  right  to  the  lower 
left.  On  the  previous  color  page,  user 
interaction  is  illustrated  as  an  actual 
finger  f’  tng  gesture  on  a  touch  sensi¬ 
tive  pad  embedded  in  the  arm  of  a  leather 
easychair. 


Unanswered  questions  about  computer  media 
include:  are  there  similar  chunks?  what 
purposes  do  they  serve?  what  use  does  the 
sense  of  place  serve?  are  there  meaningful 
gestalts?  The  purpose  of  this  paper, 
accompanied  by  video  tapes  and  verbal 
presentation  at  the  IEEE  meeting  on 
communications,  is  not  to  answer  these 
questions,  but  to  pose  them  as  serious 
issues. 
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TALKING  PAGES 


PERSONALIZED  PAGES 


In  the  same  way  that  it  will  become  diffi¬ 
cult  to  buy  a  calculator  or  television 
that  does  not  tell  time,  it  is  this 
author's  feeling  that  it  soon  will  become 
difficult  to  buy  machines  that  do  not  talk. 
The  recent  introduction  of  the  toy  'Speak 
&  Spell'  is  a  marvelous  example  of  sound 
synch  display.*  Applied  to  the  more 
general  concept  of  books  without  pages, 
two  particular  applications  are  being 
examined  at  this  time:  mode  and  medium 
switching,  spatial  sound. 

It  is  a  common  programming  practice  to 
assume  a  mode  and  medium  of  presentation 
for  particular  data.  This  is  especially 
true  in  computer  graphics,  wherein  the 
database  is  frequently  polluted  by  the 
"line"  construct  of  drawing  practice.  It 
is  also  true  for  text.  However,  there  are 
many  reasons  to  wish  for  switching  between 
media,  with  the  same  information.  For 
example,  it  is  hard  to  browse  through 
sound.  At  the  same  time,  one  can  imagine 
addressing  a  piece  of  equipment  with  hands 
and  eyes,  wishing  for  the  assembly  instruc¬ 
tions  to  be  spoken,  one  by  one. 

The  spatiality  of  sound  is  more  adventure¬ 
some.  Here  we  are  suggesting  a  cocktail 
party  effect,  where  quadraphonic  or  octa- 
phonic  sound  systems  produce  spatially 
localized  sound.  A  proposed  example  is 
for  verbal  annotations  to  be  placed  on  a 
page,  in  specific  places,  by  a  specific 
reader.  Return  to  these  annotations  is 
achieved  by  a  kind  of  Flatland  where  the 
user  can  roam  about  the  surface,  listening 
to  all  the  sounds  in  parallel,  but  properly 
attenuated  as  a  function  of  their  distance. 
How  many  times  have  you  overheard  your  own 
name  at  a  cocktail  party? 


*  The  technological  achievement  of  this 
particular  device  is  remarkable  and  well 
acclaimed.  In  the  context  of  this  paper, 
it  has  an  additional  property  which  is  so 
obvious  we  tend  to  overlook  it.  That  is: 
portability.  The  unit  and  its  batteries 
are  small  and  light  enough  to  curl  up 
with  in  bed,  take  on  airpxanes  or  in  cars, 
and  to  put  on  a  shelf  1 


As  computational  resources  increase  in 
power  and  decrease  in  cost,  we  hear  more 
and  more  about  the  so-called  "personal 
computer."  This  is  an  unfortunate  name, 
given  the  true  thrust  of  the  movement  at 
this  time.  The  computers  about  which 
people  are  talking  are  not  really  personal 
and  in  no  sense  personalized  (3).  Instead, 
they  are  available  at  sufficiently  low  cost 
so  as  not  to  have  to  share  them. 


Personalization  comes  in  two  flavors.  The 
easiest  form  of  personalization  to  achieve 
is  that  of  variety.  If  the  choices  are 
large  enough,  individual  selection  can  be 
seen  as  a  mild  form  of  personalization: 
print  in  preferred  type  fonts,  right  handed 
versus  left  handed,  and  the  like.  At  the 
other  extreme,  the  most  difficult  to 
achieve,  is  personalization  that  comes  from 
knowing.  Human-to-human  discourse  enjoys  a 
wide  range  of  abbreviations  and  subtleties 
gained  through  familiarity,  shared  meta¬ 
phors,  and  the  complicated  mechanisms  of 
inference  making. 

There  are  some  middle-ground  examples  that 
begin  to  illustrate  a  kind  of  Z-axis  for 
books  without  pages.  Early  implementations 
of  our  Spatial  Data  Management  System  (SDMS) 
(4,5)  were  a  laminar  of  "pages."  More 
information  or  elaborations  were  gained  by 
literally  flying  through  words  or  pictures. 
Their  expansions  can  be  made  very  personal 
and  invoked  implicitly.  A  simple  example 
in  a  text  processing  application  is  the 
automatic  expansion  of  acronyms  that  one 
does  not  know  or  has  forgotten  since  last 
reading. 

A  slightly  more  ambitious  example  of  a 
personalized  page  can  be  derived  from  work 
currently  being  done  on  "personalized 
movies . "  These  are  movies  whose  apparent 
content,  form  and  medium  is  the  intersec¬ 
tion  of  a  set  of  resources  and  a  model  of 
the  user  contained  in  a  computerized  play¬ 
back  system.  A  cookbook  created  this  way 
is  an  exemplar:  Consider  the  proverbial 
instruction  "cook  until  done."  (6)  This 
is  meaningful  to  the  experienced  chef.  A 
less  qualified  cook  may  need  to  know  the 
time  and  temperature;  a  beginner  may  need 
to  be  reminded  to  preheat  the  oven,  and  to 
place  the  dish  on  the  center  rack.  Re¬ 
visiting  this  recipe,  the  fast  learning 
tyro  may  need  only  a  reminder  of  the  oven 
heat,  whereas  a  forgetful  expert  may  need 
to  be  reminded  of  all  of  the  steps  again, 
but  in  brief  form. 
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PAGES  WITH  PLACES 


Likewise/  information  in  a  book  may  be 
transmitted  as  a  function  of  previous 
knowledge  and  experience  with  the 
material,  the  number  of  times  that  the 
knowledge  has  been  similarly  accessed, 
etc.  And  it  may  be  expressed  in  a 
form  suitable  both  to  the  particular 
subject  matter  and  the  particular  user. 
With  the  wide  variety  of  modes  and 
media  presently  becoming  available, 
the  range  of  this  communication  is 
extensive. 


In  the  bottom  right  hand  drawer  of  my  desk 
can  be  found  an  orange  sheet  of  paper  in  a 
red  Pendaflex  folder  near  the  back,  labeled 
"hardware."  In  that  sentence,  the  label 
"hardware"  is  the  least  significant  cue  to 
finding  data.  The  most  significant  cues 
are  spatial. 

As  human  beings  we  have  a  deep-rooted  and 
fine-tuned  perceptual  mechanism  for  space. 
While  some  people  enjoy  a  more  developed 
sense  of  place  and  visual  thinking,  even 
the  lowest  common  denominator  of  human 
abilities  is  a  fabulous  navigational  aid 
and  information  retrieval  mechanism.  The 
management  of  our  own  desk  tops,  kitchen 
closets  and  book  shelves  are  but  a  few 
examples  of  "data"  accessed  by  where  it  is, 
versus  what  it  is. 

The  Spatial  Data  Management  System,  SDMS 
(7,8),  is  one  attempt  at  incorporating 
spatiality  into  the  process  of  information 
retrieval.  The  basic  structure  of  the 
system  includes  an  "infinite"  two  dimen¬ 
sional  surface  called  Dataland,  upon  which 
data  are  placed,  in  a  variety  of  forms, 
sometimes  in  neighborhoods,  frequently  with 
landmarks.  Such  data  is  accessed  by  "flying" 
to  it,  where  movement  in  X  and  Y  is  traver¬ 
sal  over  this  ficticious  country,  and  X  is 
a  helicoptering  effect  that  affords  greater 
or  less  resolution  as  a  function  of  distance 
from  the  surface.  Perusal  or  "reading  the 
book"  can  be  seen  as  landing,  but  in  this 
case  on  data  types  which  include  more  than 
surrogate  pages:  animation,  sound,  movies, 
slides,  and  the  like. 
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BOOKS  IN  WHICH  WE  MIGHT  LIVE 


REFERENCES 


SDMS  has  the  added  theme  of  the  human 
interface.  The  terminal  is  itself  a 
room,  currently  equipped  with  floor  to 
ceiling  display  (twice  as  large  as  the  one 
illustrated) ,  octaphonic  sound,  position 
sensing  devices  for  body  and  arm  movements, 
and  soon  to  get  a  formidable  eye  tracking 
system  and  continuous  speech  recognizer. 
This  gaggle  of  equipment  is  assembled  with 
the  idea  of  going  to  the  fullest  extreme 
of  human  interfacing,  leaving  no  channel 
untapped  and  no  mode  or  medium  of  presen¬ 
tation  unused.  We  propose  that  later  one 
can  retrench  from  such  hyperbole,  evaluat¬ 
ing  the  effectiveness  of  one  method  or 
another,  but  that  the  human  interface  can 
no  longer  be  ameliorated  by  baby  stepping 
with  small  incremental  changes. 

The  Media  Room  (9)  is  a  place.  The  user  is 
not  perched  in  front  of  a  small  black  and 
white  window  (polluted  by  fan  noise). 
Instead,  the  user  is  invited  to  engage  with 
human  size  displays,  arm  wave,  or  rest  back 
and  listen.  At  first  thought  one  can 
imagine  a  circus  or  world's  fair.  But  more 
like  books  without  pages,  one  can  envisage 
a  universal  encyclopedia  that  takes  you  to 
Patagonia,  sings  Cosi  Fan  Tutti,  animates 
the  preparation  of  Coulibiac,  or  monitors 
the  progress  of  herpes  zoster. 
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